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ABSTRACT 

An evaluation system which was used to monitor the 
progress of resident physicians in the Family Practice Residency at 
the University of North Carolina is discussed. The. system was 
designed as an information management system which reflects both 
broad philosophical principles and goals as well as specific 
behavioral objectives. The three major, components of the system are 
described and illustrated in the appendix: (1) training xjoals, 
grouped under three domains (knowledge, skills> and attitudes) and 
three roles of the family physician (clinician,\o^anager of the 
practice, and professional); (2) a data collection subsystem in which 
(a) faculty complete check lists bp c ed on reviews of patient charts 
and encounters "with patients, '(b) a standardized test is 
administered, and (c) data are processed by microcomputers; and (3) a 
subsystem for using the data to assess resident performance and 
provide educational direction. Educational implications are ! 
discussed^ as well as implications for program design and management. 
(GDC) 
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. PRECIS I 
' . COWONENTS OF A SYSTEM FOR /EVALUATING 

PROGRESS OF PROFESIOMALS IN-TRAINING v 

v- 

This paper describes the components of an ev&luetion system for a professional 
training program. The key features in its design include an information manage- 
ment sy6tem structure and tha use of practice prinpiplas to focus evaluation 
deta collection on parformanca of actual practice skills. An example of an 
evaluation system for monitoring progress of resident physicians in a Family 
Practice residency i6 gi van to illustrate the epplication of this System. Tha 
necessary /components described in this evaluation system include e set of 
training goals, e dete collection subsystem, and a subsystem for consistent use 
f of the flata in guiding trainees' development end- laerning. Educetionel implice- 
tions are discussed along with implications for progrem design end manegement. 
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COMPONBfTS OF A ..SYSTEM FOR EVALUATING 
PROGRESS OF PROFESSIONAL IN-TRAINING 



Training prof essioo^ls for careers in medicine, the allied heelth profea- 

\ 

Bions, and law is a demanding tesk. People training to practice these profes- 

■ ( 

sions must acquire an extensive knowledge base and complex procedural, communi- 
cative and integrative skills.. They roust also adopt a set of professional 
attitudes of thai r o*tn consistent with those established by practicing profes- 
sionals. Designing educational programs for such a complex sat of learning 

tasks is a raal challenge, and nothing is more challenging than establishing 
> 

effective methods of evaluation for them. 

In family medicine residency training, one* popular approach has been to, 
incorporate evaluation as part of a "systematic instructional design" approach 
to curriculum construction. With this approach the knowledge, skills, and atti- 
tudes for professional competency are identified and stated as behavioral Lear- 

ning objectives. Evaluation determines whether or not the learning objectives 

/ • 
are achieved (FiTbeck, 1983).* The result of thiB Approach has been a plethora 

of N content and learning objectives listings (FHFA Curriculum Committed, 1983; 
The Royal NZ Collage of GP, 1983; C%C Committee, 1971; Baker & Gordon, 1974). 
Tne numbers of objectives orv thase Listings are bo numerous that, for evaluetion 
purposes, this approach has created as many problems as it has resolved. 

With a vast array of objectives, all objectives cannot be assessed indivi- 
dually. Setting priorities to narrdw the^sqope for evaluation is no£ eaei ly 

accomplished. Suppose one chooea? to evaluate for minimal competency. In order 

V " * \ * 

to do that it must Jt>a possibla to establish a blear definition of minimal 

competency behaviors. Though professibnal skills and knowledge aria acquired in 

an additive feshion, ov'er time*, the^ do "hot accrue in a very* predictable way and 

are not strictly hierarchi cat. Also, minimum competency may be situational. 

The same medical misteke ma.y t have no impact or may induce J.ife threatening 
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complications depending on the context. Under these conditions, defining object 
tives for minimeL competency becomes problemetic, since we cennot sey absolutely 
what skills, knowledge or ettitudes must exist before more "edvenced" levels of 
performance can be expected. 

This paper describes an eveluetibn approech which m?y help program designers 
with the complexities of ev^lueting professionals in graining'* It is. designed 
primeVily to provide the formative feedbeck needed by treinees to improve their 

professional work, though summetive evaluation cen be included, end alternete 

> 

analysi s procedures cen supply program evaluation data. However, summative end 

i 

program evaluation will not be included in this discussion. 

There ere two fundementel precepts for the ^valuation system outlined hers. 
First, it is basicelly structured ias en informetion manegement system. Jelly 
jand Friedman (1980] despribed the besic components of e systematic approech to 
resident eveluetion which "seeks to integrate all parts of the process of deta 
collection end interpretetion into e unified whol^." In this approech careful 
ettention is givlan to how information is used as weU^as considering the usuel 
methodological issues associated with evaluation research. The basic aspects of 
the system described by Jelly end Friedmen were: 



o multiple sources of data 

o structured periodic occesions for* shoring information with trainees 

o outcomes from these occesions in the form of chenged behevior, progrem 
adjustments for the individual end written reports which became another 
source of date for future conferences with treinees 

The system being discussed in this paper is an expansion of* this besic 

st ructure • 

TH8 second unique chareeteri sti c is a set of well defined guiding princi~ 
pies of practice, These principles reflect the fundentent8l philosophy of the 
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discipline end imply something ebout the pragmatic practice of the profession^. 

Properly conceived, such principles serve to define e few broad domeins under 

5 
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which mora specific bahavioratLy stated training goals can be subsumed. These 
goals cen then be expressed as a set of behavioral axpectetions to which 
trainees 1 performence can ba compared. Like othar "domain 1 ' concepts in educa- 
tion (Pophem, 1975) f these provide an organizational structure for item con- 
struction and instrument development. Oerivin'g behavioral objectives from 
practice principles also improves the probability that evaluation date will 
meesure progress toward educational goals with validity* 

EVALUATION SYSTEM EXAMPLE 

The Femily Prectice Residency et the University of North Ceroline 
has asteblished.an evaluetion system designed to incorporate the two key orgeni- 
zetionel precepts outlined above. The purpose of the system is to provide 
opportunity for the progrem designers, edmi ni strators and faculty to obtain, 
interpret and use informetion ebout thfc^performence of resident physicians to 
batter guide their development into competent physiciens. 

The systam consists of thrae major components: 1) e set of training goals, 
2) a dete collection subsystem, and 3) a subsystem for using the* data to essess 
.resident performence and provide educational direction. A conceptual diagram 
of the system is included in the Appendix. Each of these will ba discussed. 

TRAINING, GOALS 

A set of treining goels hes been defined. They ara grouped under three 
Leerning domeins end according tt three "possible roles family physicians must 
fulfill. The Learning domainsv^ra knowledge^ skills and attitudes, standard 

classifications usad in educationel design. The three roles are clinician, 

\ 

v " 

practice meneger find professional. The clinicen role includes activities con- 
cerned directly with patiant care. The practice roanagai^role is concerned wittf 
knowledge end skills necessary to sat up and menege e smell business, like a 
practice. The professionel role is defined by those ectivities which ara re- 
qui red to maintain professional affiliations, remain up-to-date end practice 



within l8gal anjl ethical standards. Also included in this role ere research 
activities to increase knowledge within the discipline* The treining goels ere 
listed in tho Appendix. 

T Special efforts heve been made to define explicitly the goels essociated 
with the clinical rale. Eerly in 1984 ar tesk force of feculty and residents in 
the UNC Deportment of Femily Medicine developed definitions for e set of princi- 
pies which Shahady (1982) raceqtly described es those most germeine to the 
practice and taeching of Femily MecHcine. These six principles ere compre- 
hensiveness, continuity, coordi neti on, prevention, community ori' tiofl qnd 
femily orientetion in the prectice of primery health care. The purpose of this 
tesk force wss to determine how we might evaluate the teaching of these 
"Principles of Family Medicine." The Tesk Force defihi tions, of these Principles 
developed ere listed in the Appendix. The worfcyOf the Tesk Force precipitated 
the revision of resident performance eveluetio^, inqluding the statements of 
training goals/ i nstruments for deta collection and our feedback system to 
residents • 

Training goals for the clinician role category were related to the six 
Principles wherever possible. But probebly the mo^si gni f icant accomplishment 
of the group was the identificetion of e set of clinical behaviors which faculty 
felt were indicative t^at the six Principles were being epplied in practice. 
Instruments were then developed that faculty could use in their teaching to 
record the presence or ebsence of these behaviors in residents' patient care. 
DATA COLLECTION 

Date sources include people who work with residents and can assess their 
performences fairly, records of patient encounters, and any formal testing or 
assessment conducted by the progrem administrators. Th^se^sources are enu- 
mereted below. 



o Inpatient end Outpatient Cere Experiences Except in Fern* Ly Prectice Center 

1) Evaluation forms completed by ettendings when residents complete 
their various service rotetions 

2) Documentation of inpetient procedures end diegnoses meinteined in 
computer files for each resident 

o Patient Cere in the Femi ly Prectice Center 

r- 

1] Profiles produced by computer of the number, ege, sex end rece of 
patients end the diagnostic entities recorded by each resident in 
the Fami ly Prectice Center (FPC) 

2] Observations of residents' petient cere in the Center recorded by 
feculty preceptors. i 

o Standardized Assessments 

f Seores from the Americen Boerd of Femily ^^ectice In-Treining Exam, en 
indicator of the progress residents ere meklng in ecquiring the necessery 
know Ledge base. 

Instrumentation . Instruments for dete collection heve been designed to 
essess the training goals. For example, the resident evaluation instruments 
from services are designed to essess knowledge of diseese processes, clinicel 
skills, and working relationships with peers, steff end petients, Feculty 
members defined beheviors which ere indicetors for epplicetion df the six 
Principles end check lists have been designed to record the presence or absence 
of these beheviors in residents 1 petient cere. Feculty ere eeked to complete 
these forms es pert of their duties in three reguler teecliing activities: chert 
reviews (f ace- to-fjace reviews of residents 1 petient cere efter eech helf dey of 
care), ective precepting (live TV monitoring of residents 1 petient encounters), 
and AV reviews (reviews of video taped patient encounters). 

Data Collection and Storage . An essential element in any information 
management system is the process of data collection and storege. Someone must 
be responsible for forms distribution and collection. There must be some meens 
for entering data ^fito files and storing it in a manner which facilitates 
retrievel for exeminetion and/or report. In the system outlined here clerical 
staff* monitor tha distribution end ratrievel of dete collection forms. Non- 
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respgndents are contected to ensure thet informetion is not Loet. CLericeL end 

research eupport steff enter the dete on microcomputer systems for processing. 

> 

This includes upLoeding to e mein freme, if file size requirements necessitate 
Larger systems for finel processing 
. USING THE DATA - 

Effective use of dete for eveluation of treinees' educational progress 
depends on two things: 1) thq>quelity of output possible from the dete storage 
sytem end 2) the provision of jjpoortuni ties to ehere the informetion with educe- 

re- - 

tional intent. Eech treinee.Hes a personel file contejning ell completed eve- 
luetions end computer generetynk-fc^orts ,of thei r^indi viduel work and treining 
experience. Eech trainee 1e also assigned e teem of two fecalty edvieors who 
ere reeponeible for monitoring end guiding the residents 1 profeseionel growth 
end development during thei r* three years of training. \ 1 

Re porting . A set of summery reporte are now eveilable in the UNC Family 

Prectice Residency evaluetion system which cen be ueed to essess residents 1 

« * 

progress. These include profilee of individuel prectices, finenciel producti- 
vity reporte, documentetion of diegnoees end procedures on other services, 

» 

summeries of service rotation eveluetions, resuljts^of the ennuel A0FP In-Trei- 
ning Exem, end, mfcst recently, a summery of the degree to which Principles of 

Femily Medical cere ere epplied in e reeident's own prectice. Efforts heve been 

*» 

made to structure the reports eo thet informetion will be meeningful. Wherever 

- 1 * 

possible, individuel information eppeers with clese or progrem date eo compari- 
eone cen be drewn. Detei Led dete are eummarized to the most concise level 
ettaineble without Loss of ueeful information. ^ 

Advisor Syste m . A criticeL element in the educetionel epplicetion of the 

s 

j-oveluetion dete is e structured resident edvisor syetem. Eech resident hes two 

. / 

eeeigned faculty advieors end each pei r of advisore works with three residents. 

* n 

The rolee end reeponsibi Li tiee of the edvisors heve been cLeerly defined in 6/ \ 

r - • ' ) ^ 
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sat of written guidelines. These ere clarified in e dynemic wey through peri- 
odic meetings of the edvisors to discuss the whole edvising process and modify 
it. 

Advisors ara responsible for using evaluetion dete to assess their edvi- 

) 

sees' progress. Periodic conferences (celled Educetionel Prescription Con- 
ferences) ere' held for residents end their faculty edvisors to review treining 
progress. The mein purpose of the Educational Prescription Conferences is to 
set .educetionel goels end identify stretegies for echieving them. During these 
conferences residents 1 treining experiences ere reviewed end discussed using the 
dete eveileble from the informetion system. During these discussions the pro- 
grem's treining goels era used to identify problems, issues, strengths end 
weekne^ses releted to the resi denVe'ebi Li ty to function as a family physicien. 
Written reports outline whet was discussed end en educetionel prescription 
consisting of goels end stretegies for their echievement. These repor.ts become 
e part of the resident's permenent file to be referred to et the next conference 
es e yerdstick to measure the resident's progress. 

DISCUSSION 

Two things heve prompted the presentetion of the eveluation system des- 
cribed here. First, the basic systematic design hes existed in this setting for 
several yeers end hes proved to be functionel. There is a possibility thet 
others might find it to be equally useful in their own settings. Second, there 
hes been en importent shift within the progrem in the wey goels end objectives 
for treining ere being viewed. Assessment of treinee progress is beginning to 
focus on specific beheviors. These beheviors heve been identified es indicetors 
tftet key principles of the prectice of Femi ly Medicine ere evident. This dis- 
cussion wilt address eech of these points in more detei I. 

The systems design approech hes one e lementery* f eeture thet will leed to 
positive outcomes if the epproach is adhered to in e disciplined wey. Its 

to 



application requires en orgenized plen. There must bean initial definition of 
the eveluetion problem, the resources evei Labia to resolve the problem and 
strategies thet ere possible to eddress it* The neturel result of this enelytic, 
^ process is e plen for development of the eveluetion system. Information gaps 

ere identified end, over time, resources cen be systemetice I ly brought to bear 
on the deficits. Eventuelly, such effort cen be expected to improve both the 
quelity end quentity of dete which is eveileble. This hes certainly been the 
case in tjhe system described here. Educetionel Prescription Conferences heve 
elweys been velueble opportunities for faculty end residents to exchenge per- 
spectives about progress end to set treining goels. However, there wes often 
the feeling thet educetionel judgments were being mede with e very reel paucity 
of informetion. Recently, there hes been e noticeeble increese in the emount of 
informetion eveileble to faculty conducting these conferences. Feculty comments 
seem to imply that this hes mede the quality of the conferences better. 

With systems thinking, menegement of the eveluetion system cen be fecili- 

\ 

teted es well. Tesks within the system ere reedi ly defined es pert of the ^ 

design of the system itself. Assignment of the tesks cen then j)e mede on the 

basis of the skills end treining necessery to get them done. In the system 

described here clencel end research support steff heva' been essigned the ,dey- 

to-dey jobs of forms distribution endj co L Lection, dete entry end filing. This 

leeves feculty free to use the information for educetionel guidence end decision 

meking.v Microcomputers heve elso been found to be useful tools for meneging 

* 

dete genereted in the system end heve provided the cepebility of heving current, 
complete informetion with mi nime L'personne L increese6. 

The use of e "principles approach" to the definition of training goels in 
t^Te progrem hes been exciting for e couple of reesons. First, beceuse defini- 
tions of the principles wece oriented to the prectice of Family Medicine, they 
lent themselves very reedi Ly to e process of defining behevioreLLy whet feculty 



should be Looking for in residents 1 petient encounters. From defining ob&er 
vable prectice baheviors it wes a netureL step to design instruments which focus 
on recording the presence or ebsence of those beheviors on the part of resident 
when seeing patients. Validity of the meesures phich are taken under these 
ci rcumstences is highly probeble. The reliability mey be another question 
Agreement among a set of independent fecutty ebout existence of a particular 
behavior may not elweys be eesi ly reached and the reliability of tnese evalua 
tion date will need to be established. 

Another innovative aspect to what is being done in this epproach is that 
the influence of eveluetion on what leerners learn is being considered* It it 
an established phenomenon thet Leerners are strongly influenced to leern what u 
being used to judge r £heir performencss (Frederi ksen , 1984), The leerners figure 
out eerly whet rea I ly counts end strive for proficiency in these areas. At this 
program faculty went Leerners to Learn e practice medicine consistent with high 
stenderds of primery care end with the phi Losophi ce I bese from which Family 
Medicine works. By deliberately gathering data which provides information 
evaluating the degree to which residents epply these concepts in their own 
prectices, the chences ere being weighted in the direction of their developing 
practice habits consistent with these treining goels. 

The system is not perfect. No system will be or cen be and there are areas 
thet still need attention. The need to establish the reliability of the data un 
prectjce beheviors hes elreedy been mentioned. More information is also needed 
about residents' prectices, perticulerly regerding procedures done in the FPC T 
drug prescriplion petterns, end petterns of office leboratory usage. It would 
also ba instructive to heve information about interrelationships which might 
exist between perticuler diegnoses and petterns of drug and laboratory usage 

Finally, an erea which is neglected here as in most clinical treining 
programs is a structured assessment of residents 1 clinical skills development. 
Objective meesures cen be teken using Objective Structured Clinical Exams or 

ERIC 15L 



Orel Examination routines. Oral examinations can also address clinical problem 
solving abilities though validity of thiB measure and others trying to essess 
this skill aree ere suspect. However, the development end edministretion of 
these types of meesures is coetly in time and personnel resources end it is eesy 
to lower the priority for their development because of thet. 

The evaluetion system described here provides a unique epproech for evalua- 
ting professionals in training. Its systametic design hss practical merit for 
program development purposes. The relationship between professional practice 
and the treining goals astablished by defining principles of practice is sound 
from the standpoint of curriculum and i /TstrUctiona L design. The evaluation 
system 1n Its present form represents an evolutionary product which has deve- 
loped over time. It seems to have the capacity for continued expansion and 
refinement to meet the needs of a program as its educetional epproach evolves 
and becomes more sophisticated. The final judgment of how well the system works 
will depend on the extent to which residents end feculty feel it continues to 
serve their needs in receiving ^nd giving educational direction. n 

\ 
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APPENDIX 



A. Evaluation System Diagram 

B. Definitions of t(ie Principles of Family Medicine 

C. Training Goels for Femi ly Medicine 



15 



v 



9 

ERIC 



, O 

M CQ 



RESIDENT PERFORMANCE EVALUATION^ SYSTEM : 
A CONCEPTUAL MODEL 



SERVICES 




E 



TAMILY PRACTICE, CENTER- 

- — Y- 



RESIDENCY PROGRAM 



-EVALUATION FORKS 

-DOCUMENTATION 
(COMPUTER REPORTS) 



-ENCOUNTER FORMS 
"(PRACTICE PROFILE 
COMPUTER REPORTS) • 

-EVALUATION FORMS FROM 
TEACHING ENCOUNTERS 
(CHART REVIEW, PRECEPTING, 
AV REVIEWS) * 




-ABFP IN-TRAINING EXAM 



-ORAL EXAMS CONSTRUCTED 
BY FACULTY 



TRAINING 
GOALS 



EXPECTATIONS 

• OF 
PERFORMANCE 




[ 



REVIEW DATA 

W- 



SYNTHESIZE DATA 
■1 " 



EDUCATIONAL 
PRESCRIPTION 




COWARE IMPLICATIONS 
WITH EXPECTATIONS FOR 
PERFORMANCE . 




CONDUCT 
-f^EDUC: PRESC; 
J .CONFERENCE 

lMHMHnHMnBMW 



FACULTY/ STAFF 
WITH NEED TO 
KNOW 




17 



DEFINITIONS: PRINCIPLES OF FAMILY MEDICINE 

Comprehensiveness: Family physicians deal with a wide spectrum of 
diseases and health problems not limited by age or other characteristics of 
the population served. They are able to engage in responsible decision 
making in *he management of health care for every patient. They have the 
ability to recognize the physical, social, psychosocial and financial aspects of 
illness and develop an elective plan. 

Family Orientation: Family physicians regard patients as members of a family 
system, and recognize the effect of the illness on the family, as well as the 
family on the illness. They have the ability to work with families in their 
adjustment to predictable life cycle crises as well as unexpected events. 

Community Orientation: Family physicians understand the influence a pa- 
tient's community has on his/her health and illness patterns, and is aware 
of the available health care resources. They can use this knowledge to direct 
data collection and gain vital information about the potential epidemioloqv of 
diseases. 

Continuity: Family physicians are committed to providing care to members of 
a family, or living unit, over time. They are capable of utilizing time for 
diagnostic and therapeutic purposes, and being committed to contracting 
with patients for long term health care. 

Coordination: Family physicians regard patients as partners in the 
management of their health problems - they coordinate the adminis- 
tration of therapeutic options in direct care and/or when consultation or 
referral are used. When necessary, they serve as a patient advocate within 
the health care system. 

Prevention: Family physicians regard the prevention of illness to be as 
important as its care. They strive to identify health risks within their practices 
They attempt to promote behavior which will establish a better state of 
health, prevent further illness and/or reduce risk factors. 
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EXPECTATIONS FOR PERFORMANCE 
A SET OF TRAINING GOALS FOR FAMILY PRACTICE RESIDENTS AT UNC-CHAPEL HILL 



KNOWLEDGE 

Possesses sufficient knowledge of 
Disease processes, especially common 
end chronic diseases and ones which 
endanger life or have serious com- 
plications or consequences. 
iComprehensi veness) 

Knows the appropriate therapeutic 
interventions and regimens to 
select for treeting primary care 
disease entities and their com- 
plications (Comprehensiveness) 

Understands how the elements in a 
person's social systejrt oey affect 
health and llinass patterns. (Fami- 
ly, Community, Comprehensiveness, 
Prevention ) 

Knows the community resources 
available and other health spe- 
cialists to help manege patients' 
health problems. (Community, 
Coordination) 

Understends the opportunities, 
methods and limitations of preven- 
tion, eerily diagnosis and health 
promotion m family practice 
settings s (Prevention) 

Understands dynamics of family and 
interpersonal relationships and 
heelth problems. (Family) 



SKILLS 

1. Collects complete deta includ- 
ing physical, psychological and 
social information with thorough 
and accurate interviewing and 
phys . exam techniques. ( Compre- 
hensiveness, Family, Community) 

2. Synthesizes clinical data to 
formulate comprehensive h^i ffer- 
ential diagnoses and to select 
feasible working diagnoses. 
(Comprehensiveness, Fami ly, 
Communi ty ) 

3. Safely conducts diagnostic and 
therapeutic procedures needed 
in treatment and management of 
primary care diseases. (Comp- 
rehensiveness) 

4. Uses empathy properly to estab- 
lish rapport with patients. 
(Conjinui ty ) 

5. Hakes, appropriate treatment 
decisions for evary problem 
which presents. (Comprehen- 

* siveness, Coordination) 

6. Usas pme as a diagnostic and 
therepeutic tool. (Continuity) 

7. Uses appropnota referral and 
consultation techniques and 
procedures, ( Co orfi nidation) 

8. Conducts sho>t-tenn individual 
and family counseling when op-* 
propriata. (Family, Continuity) 



ATTITUDES 

1. Adapts methods of communication 
and information collection to 
individual patient's social beck- 
ground and capacity to understand 
and communicate. (Comprehensive- 
ness, Community, Family) 

2. Regularly attempts to identify 
petients "at risfc" through con- 
sistent screening procedures and 
employs regular patient educa- 
tion efforts into practice. 
(Preventi on) 

3. Develops practice habits which 
facilitate appropriate followup 
and tracking of petients 1 care 
over time. (Continuity) 

4. Culti votes positive working 
relationships with partners, n, 
paers and members of other 
health cere professions. 
(Coordination, Community) 

5. Regards the patient os a 
partner in the process of im- 
proving and maintaining the 
individual's health status. 
(Coordination , Prevention) 
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KNOWLEOGE 



SKILLS 



ATTITUDES 





Pract 1 ce 
Manager 



1. Understands Che basic principles 
of sound practice setup and 
management . 



1. Uses time as an orgam zat icnal 
tool for planning practice de- 
velopment and in management of 
patient flow. 

2. Manages nursing and office 
staff in accordance with 
principles of productive 
supervision. 



Conducts practice in a manner 
consistent with ethical busi- 
ness practices and appropriate, 
concern for fair charges and J 
returns for services. 



Other 1 . Understands tha meaning of 

Professional / "ethical" behevior and us 

Roles importance to patients and 

the professions. 

* 2. Understands the basic methods 
I of reseerch. 

3. Knows the pertinent medico- 
sociel legislation and its 
impact on both physicians and 
patients. 



1. Evaluates own clinical 
abilities and knowledge to 
assess learning naeds. 

2. Applies the rudiments of * 
statistics to practice data 
to gain undarstending of the 
epidemiology of the prectice. 



1. Engages in activities to main- 
tain an up-to-date knowledge 
base and to facilitate progrees 
in personal growth and develop- 
ment consistent with an atti- 
tude which values lifelong 
leerning. -. 

2. Engeges in an ethically sound 
prectice of medicine. 

3. Exhibits work habits consistent 
with valuing thoroughness end 
conscientious attention to 
accuracy . * 
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